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Abstract:   Recurrence  formulas  arising  from  the  analysis  of 
divide  and  conquer  algorithms  are  considered.   It  is  shown 
that  the  balancing  principle  is  not  always  valid.   General 
solutions  and  error  estimates  are  provided. 
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1.   Introduction 

The  time  complexity  of  divide  and  conquer  algorithms  is 

often  determined  from  a  recurrence  relation  of  the  form 

c(n)  =  min  c(i)  +  c(j)  +  f(n) 
i+j=n 

c(l)  =  f  (1).  (1.1) 

c(i)  and  c(j)  is  the  time  required  to  solve  two  subproblems  of 
size  i  and  j  respectively,  and  f(n)  is  the  time  needed  to  combine 
these  two  solutions.   Typical  examples  are  merge-sort  (f(n)=0(n)) 
and  maximum  finding  (f(n)=0(l)). 

When  analyzing  such  problems  it  is  always  assumed  implicitly 
that  an  optimal  solution  to  1.1  is  obtained  by  taking  subproblems 
of  equal  sizes;  This  is  the  famous  "Balancing  Principle"  [1,§2.3], 
The  recurrence  1.1  is  therefore  replaced  by  the  recurrence 

c(x)  =  ciL^/zS)    +   c(rn/2l)  +  f(n), 

c(l)  =  f  (1).  (1.2) 

The  next  step  is  to  solve  the  functional  equations 

c(x)  =  2c(x/2)  +  f  (x)  , 

c(l)  =  f(l)  (1.3) 

and  use  the  solution  as  an  approximation  to  the  correct  solution 
of  1.2. 

We  elaborate  in  this  paper  on  each  of  these  steps. 

First,  under  what  conditions  is  the  Balancing  Principle 
valid?   It  turns  out  that  it  is  valid  whenever  the  function  f 
is  convex.   However,  if  f  is  concave  an  optimal  solution  to  1.1 
is  obtained  by  "unbalancing"  as  much  as  possible.   The  problem 
turns  out  to  be  related  to  that  of  building  binary  trees  of 
minimal  sum,  where  "tree  sum"  is  defined  to  be  a  generalization 
of  the  external  path  length  function. 
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Next,  we  suggest  a  simple  analytic  formula  to  bound  the 
error  involved  in  using  a  solution  to  system  1.3  as  an  approxima- 
tion to  the  solution  of  system  1.2.   Finally,  we  give  a  general 
solution  to  the  system  1.3. 

Our  results  validates  the  usual  analysis  of  the  recurrence 
relation  1.1,  for  convex  f.  When  f  is  concave,  and  therefore 
sublinear,  the  solution  to  1.1  is  0(n),  and  (un) balancing  optimally 
rather  than  evenly  only  affects  the  constant  implicit  in  the 
0  notation. 

2 .   Optimal  Splitting 

Definitions ;   The  first  order  difference  of  a  function  f  (n) 
IS  defined  to  be  Af(n)  =  A^f(n)  =  f  (n+1) -f  (n) ;  the  k-th  order 
difference  is  defined  as  A^f(n)  =  A^"-^f(n+l)  -  A'^"-'-f(n).   A 
function  f  is  nondecr easing  if  Af  >  0,  non increasing  if  Af  <  0, 
convex  if  A^f  >  0,  concave  if  A^f  <  0.   Note  that  if  f (x)  is  k 
times  differentiable  and  f(^)  >  0  then  A'^f  1    0. 

Functions  f  occuring  in  recurrence  relations  of  the  form 
1.1,  which  describe  the  time  complexity  of  divide  and  conquer 
algorithms,  can  be  expected  to  be  nonnegative  and  nondecreasing. 
Generally,  they  also  will  be  convex,  by  a  law  of  diminishing 
returns:  the  amount  of  work  required  to  handle  and  extra  item 
does  not  decrease  as  the  number  of  items  increases.  There  are 
exceptions  to  this  rule  however:  for  an  example  see  [2]. 

The  optimal  splitting  of  n,  that  yields  the  solution  to 
(1.1),  is  given  by  the  next  two  theorems. 

THEOREM  2.1.   Let  c  be  defined  by  the  recurrence  relation 
1.1.   Assume  that  f  is  nonnegative,  nondecreasing  and  convex 
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(f  >  0,  Af  >  0  and  A^f  >  0).  Then  for  n  >  1. 

c(n)  =  c(i^ri/2j)  +  c(rn/2T)  +  f(n).  (2.1) 

PROOF:   By  induction  on  n.  We  shall  also  prove  the  auxilary 
assertion 

A^c(n-2)  >  0 
Both  assertions  are  valid  for  n  <  4.   Assume  that  both  are  valid 
for  all  n'  <  n.   Let 

c{n)  =  c(i)  +  c(j)  +  f  (n) 
with  i+j=n,  0<i<j<n.   Assume  that  i  +  1  <  j  -  1.   Then 
c(n)  -  [c(i+l)  +  c(j-l)  +  f(n)] 
=  c(i)  -  c(i+l)  +  c(j)  -  c(j-l) 
=  Ac(j-l)  -  Ac(i)  >  0, 
by  the  second  inductive  assertion.   It  follows,  by  the  definition 
of  c,  that 

c(n)  =  c(i+l)  +  c(j-l)  +  f(n). 
A  repeated  use  of  this  implication  proves  equality  2.1.   As  for 
the  second  assertion,  if  n=2k  then 

A^c(n-2)  =  c(n)  -  2c(n-l)  +  c(n-2) 

=  [2c(k)  +  f(2k)]  -  2[c(k)  +  c(k-l)  +  f(2k-l)]  + 

+  [2c(k-l)  +  f  (2k-2) ] 
=  f{2k)  -  2f(2k-l)  +  f(2k-2) 
=  A2f(n) 
>  0. 
The  proof  for  n=2k+l  is  similar. 

D 
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Note  that  if  A^f>0  (f  is  strictly  convex)  then  all  the  inequalities 
in  the  last  proof  are  tight,  and  the  decomposition  that  achieves 
the  minimum  in  1.1  is  unique. 

The  optimal  strategy  when  f  is  concave  is  more  surprising: 

THOEREM  2.2.   Let  c  be  defined  by  the  recurrence  relation 
1.1.   Assxime  that  f  is  nonnegative ,  nondecreasing  and  concave 
(f>0,  Af^O  and  A^f<0).   If  3 •  2^"-'-<n^3 •  2^  then 
c(n)  =  c(2^^)  +  c(n-2^)    +   f(n). 
The  proof  we  currently  have  for  this  theorem  is  a  lengthy, 
uninstructive  case  analysis,  and  we  have  relegated  it  to  an 
' appendix. 

a 

The  last  two  theorems  are  better  understood  if  we  use  a 
binary  tree  representation  for  the  recurrence  relation  1.1. 

Let  us  define  w(T),  the  weight  of  a  binary  tree  T,  to  be 
the  number  of  leaves  in  T,  and  let  the  f-sum  of  T  be  defined  as 
^   ^f(^)  -  T'  subtree  of  T  ^(^(T')). 

Note  that  the  external  path  length  of  the  tree  T  is  equal 
to  Z^^{T),  where  id  is  the  identity  function. 

The  f-sum  of  T  can  be  defined  recursively: 

Sf{T)  =0       if  T  is  empty; 

Zj(T)  =  Zj(Ti)  +  Z^(T^)  +  f(w(T)), 
where  T^   and  T^  are  the  left  and  right  subtrees  of  T,  otherwise. 

It  follows  that  Z_(n),  the  minimal  f-sum  of  a  binary  tree 
with  n  leaves,  fulfills  the  recurrence  relation 

ZfCl)  =  f(l) 

Z.(n)  =  min   z  (i)  +  I    (j)    +    f  (n) . 
i+j=n   ^        ^ 
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We  have  proven  that 

THEOREM  2.3.   If  c  is  the  solution  to  the  recurrence  relation 
1.1  then  c(n)  is  equal  to  the  minimal  f-sum  of  a  binary  tree  with 
n  leaves. 

Theorems  2.1  and  2.2  can  now  be  seen  to  be  assertions  about 
the  structure  of  minimal  f-sum  trees.   Clearly,  minimal  f-sum 
trees  are  extended  binary  trees  [3,  §2.3,4.5]:  each  node  has 
either  two  children  or  none. 

A  binary  tree  is  said  to  be  (weight)  balanced  if  its  left 
and  right  subtrees  are  balanced,  and  their  weight  differ  at  most 
by  one.   Note  that  this  definition  is  different  (stricter)  than 
that  usually  given  in  the  literature.   We  can  now  restate  theorem 
2.1: 

THEOREM  2.1'.   If  f  is  nonnegative ,  nondecreasing,  and  convex, 
then  balanced  trees  have  minimal  f-s\im;  if  f  is  strictly  convex, 
then  a  tree  has  minimal  f-svim  iff  it  is  balanced. 

A  balanced  tree  with  10  leaves  is  shown  in  Figure  1;  Figure 
2  shows  a  tree  with  10  leaves  that  fits  the  conditions  of  theorem 
2.2.   Before  discussing  it,  we  need  the  following  definitions. 
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Figure  1 
Balanced  tree  with  10  leaves 


Figure  2 
Heap  tree  with  10  leaves 
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The  level  of  a  node  v  in  a  tree  is  the  length  of  the  path  from  the 

root  to  v;  h(T),  the  height  of  the  tree  T,  is  the  maximum  level 

h  (T) 
of  a  node  m  it.   Note  that  w(T)  <  2     .   An  extended  binary 

tree  T  is  complete  if  all  its  leaves  occur  at  the  last  two  levels 

only.   Note  that  a  complete  extended  binary  tree  with  n  leaves 

has  height  h(T)  =  rignl;  2  "      -n  of  the  leaves  occur  at  level 

h(T)-l  and  2n  -  2  '^^     of  the  leaves  occur  at  level  h(T)  (cf. 

[3,  §5.3.1]). 

A  recursive  definition  of  a  complete  tree  can  be  given  as 
follows: 

LEMMA  2.4.   An  extended  binary  tree  T  is  complete  iff 
w(T)  <  1  or 
The  left  and  right  subtrees  T   and  T   of  T  are  complete  and 

2LlgnJ  -1  <  w(T^),w(T^)  <  2^^^^"'-\  (2.3) 

where  n=w (T) . 

PROOF ;   If  T  is  complete,  then  T-j^  and  T   have  all  their 
leaves  at  levels  Tlgnl  -1  and  tJ-*?^  "!•   ^^  follows  that  both 
subtrees  are  complete  and  that  the  number  of  leaves  in  each  of 
them  fulfills  inequality  2.3. 

Conversely,  assume  that  inequality  2 . 3  is  fulfilled,  and  that 
T  ■,  and  T   are  complete.   Then  all  the  leaves  in  T,  and  T   are  at 
levels  i_lgn( -1  and  rign1-l.   It  follows  that  T  is  complete. 

D 
Note  that  a  balanced  tree  is  complete,  by  the  last  lemma. 


The  tree  illustrated  in  figure  2  corresponds  to  the  usual 
image  of  a  complete  tree:  its  nodes  can  be  numbered  from  1  to 
2n-l,  such  that  the  parent  of  a  node  k  is  the  node  Lk/2J  (the 
root  has  number  1,  and  has  no  parent).   We  define  a  heap  tree 
to  be  a  tree  for  which  such  labelling  exists.   Alternative  defini- 
tions of  a  heap  tree  are  given  in  the  following  theorem. 

Theorem  2.5.   Let  T  be,- an  extended  binary  tree.   Then  the 
following  three  conditions, are  equivalent. 

1.  T  is  a  heap  tree. 

2 .  T  is  a  maximally  unba  1  a;oce  d      ~  mplete  tree,  e.g.  T  is  complete, 
and  at  each  node  the  difference  between  the  weights  of  the  left 
and  right  subtree  is  maximum. 

3.  For  each  subtree  T"  of  T,  if  3-2  ~'''<w  (T")  <3  •  2  ,  then  T" 

k  k 

has  left  and  right  subtrees  with  weights  2   and  w(T")-2  . 

PROOF ;   1=>3.   If  T  is  a  heap  tree  and  T^  and  T^.  are  its  left 

and  right  subtrees,  then  either  T   is  full  and  has  2   leaves, 

k        k+1  k 

where  2  <w(T]^)^2    ,  or  T-,  is  full  and  has  2   leaves,  where 

k-1         k 
2    ^w(T  )<2  .   In  both  cases  assertion  3  is  valid  for  T  itself. 

Since  each  subtree  of  a  heap  tree  is  a  heap  tree,  the  inplication  follows 

also  for  each  subtree. 

3=>2.   Let  n=w(T^).   Note  first  that  2  ^"^"^-^ '^  <2^  ,    n-2''<2  ^^^"^  "^  , 

so  that,  by  lemma  2.4,  T  is  a  complete  tree.   It  is  easy  to  check 

k— 1       k 
that  if  3' 2    <n<3'2   then  |i-j|  is  maximum  under  the  constraints 

i+j=n 

2LignJ-i,i,j<2^igni-i^ 

k       k 
when  i=2  ,  j=n-2   (or  vice-versa).   Thus,  condition  3  ensures 

that  T  is  a  maximally  unbalanced  complete  tree. 

2=>1.   Assume  w.l.o.g.  that  at  each  node  of  T  the  left 


-  o  _ 

subtree  is  no  smaller  than  the  right  subtree.   Number  the  nodes 
of  T  from  level  0  to  level  h(d),  and  at  each  level,  from  left  to 
right.   If  some  node  k  has  no  children,  whereas  a  node  k",  k'>k, 
has  two  children  then  one  can  obtain  a  more  unbalanced  tree  that 
is  still  complete  by  moving  the  children  of  k'  to  k.   It  follows 
that  T  is  a  heap  tree. 

-     -    -  n 

Note  that  condition  2  of  the_;l a st_  theorem  is  exactly  the 

condition  stated  in  theorem  2»2. We-  can  therefore  restate  this 

theorem: 

THEOREM  2.2':   If  f  is  nr^  ."-iqative^  nondecreasing  and  concave, 
then  heap  trees  have  minimal  f-sum;  if  f  is  strictly  concave 
then  a  tree  has  minimal  f-s\im  iff  it  is  a  heap  tree. 

If  A^f=0,  then  both  theorems  2.1'  and  2.2'  are  valid.   Indeed, 
if  A^f=0  then  Z^  is  a  linear  function  of  the  external  path  length. 
But  all  complete  trees  have  minimal  external  path  length, 
including  the  most  balanced  and  the  most  unbalanced  ones. 


3.   Error  estimates 

A  simple  estimate  on  the  error  involved  in  solving  recurrence 
1.3  with  rational  domain  rather  than  recurrence  1.2  with  integer 
domain  is  given  by  the  following  theorem. 
THEOREM  3.1.   Let  c  be  defined  by 
c(l)  =  f{l) 

c(n)  =  c(t.n/2j  )  +  c(rn/2"I)+  f  (n) 
Let  c (x)  be  the  solution  to  the  recurrence  relation 
c(l)  =  f(l) 
c(x)  =  2c(x/2)  +  f(x) 
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Let  K  =   max   |c" (x) | .   Then 
l<x<n 

|c(n)  -  c(n)  I  <.    (n-l)K/2. 

PROOF :   By  induction  on  n.   For  n=l  c(l)  -  c(l)  =  0. 

Assume  that  3.1  is  valid  for  all  n'<n.   If  n=2m  then 

|c(2m)  -  c(2m)|  =  1 2c  (m)  -  2c(m)l< 

<  2(m-l)K/2  <  (2m-l)J^Ar.s 

If  n=2m+l  then 

|c(2m+l)  -  c(2m+l)|  •■^z^x:{ra)    -r  cdo+l)  -  2c(m+J5)|  < 

<  |c(m)  -  c(m)  I  +  !c(mi-l)  -.c:(in+l)  I  +  |  c  (m)  +  c(m+l)  -  2c(m+i5)I 

But  if  g  is  twice  dif ferenciable  then 

g(x+6)  +  g(x-6)  -  2g(x)  -  262g"{C) 

for  some  x-6<?<x+i^.   Therefore, 

|c(2m+l)  -  c(2m+l)|  <  |  c  (m)  -  c  (m)  1  +  |c(m+l)  -  c(m+l)I  +  hK 

<  (m-l)K/2  +  mK/2  +  K/2  =  (2m)K/2. 

n 

4 .   General  solution 

The  recurrence  1.3  can  be  transformed  into  a  linear  recurrence 
by  a  change  of  variables,  and  solved  by  standard  methods  (see  [4]). 
We  obtain  that  the  solution  of  the  system 
c(l)  =  1 

c (x)  =  2c (x/2 )  +  X 
is  given  by 

r2x-l  if  d=0 

c(x)r  J  xlgx+x  if  d=l 

J2^-A2^-^-l))(x'^-x)  if  d>l. 

Thus,  if  f(x)  =  Ea.x""",  the  solution  to  the  recurrence  1.3 
is  given  by 
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c(x)  =  ao  (2x-l)+ai  (xlgx+x)  +  ^^^a^  (2^""'-/ (2^  -"--l)  )  (x^-x)  = 

=  -ao+(2ao+ai-^^^(2^"-'-/(2^"-'--l)  )a^x  +,2a^(2^"V(2^~"''?)xVaixlgx. 


In  particular,  if  f  is  a  polynomial  of  degree  d,  f (x)  =  .|^a.x., 

then 

'^         ^-^        ' -^  ^      "-1    '-1 

c(x)  =  -ao+(2ao+a:-l2  ^^^  /(2^  -l))a^)x+  ^^12  ^i^^^  /^^^  -1)  )x^+aixlgx(4.1) 

d 

Assume  now  that  f (x)  =  .E_a.x  ,  and  that  f>0,  Af>0  and  A^f>0,  so 

1=0  1  -    '         -  _  ' 

that  the  conditions  of  theorem  2.1  are  fulfilled.   The  function 
c(n),  defined  by  4 . 1 ,  is  an  approximation  to  the  solution  of 
1.1,  with  an  error  bounded,  according^ to  theorem  3.1,  by 

1^  —  1 

n-  max  c"  (n)  =  0 (n    ).   We  have  therefore  that  the  solution 

l>x>n 
to  the  recurrence  relation  1.1  is  of  the  form 

ra^(2^-V(2^-^-l))n^  +  O(n^-l),  if  d>l 

c{n)    =      <ain(lgn+l)    +    0(1)  ,    if   d=l       (4.2) 

(_ao  (2n-l)  ,    if   d=0. 

Now,  if  the  leading  coefficient  of  f  is  positive, 

then  f  and  its  first  two  differences  will  be  nonnegative 
for  X  large  enough.   It  is  easy  to  check  that  the  error  involved 
in  using  the  function  defined  by  3.1  as  a  solution  to  the  recurrence 
1.1  is  still  restricted  to  the  lower  order  terms.   We  can  obtain 
the  following  result. 

THEOREM  4.1.   The  solution  to  the  recurrence  relation 

c(l)  =  0(1) 

c(n)  =   min  c  (i) +c  ( j):  +  an   +  0  (n    ), 
i+j=n 
where  a>0,  is  given  by 

(a(2^-V(2^"^-l))n^+0(n^-^)  if  d>l 
c(n)  =  ) 

(anlgn  +  0 (n)  if  d=l. 
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Appendix 

Proof  of  theorem  2.2:   By  induction  on  n:  We  have  to  prove  that  if 

3-2'^~-'-<n<3-2'^then 

c(n)  =  c(2^)  +  c(n-2'^)  +  f  (n)  (A.l) 

We  assiime  that  this  equality  is  valid  for  all  n',  n''<n. 

k  k— 1     k+i 

Let  n=n  +in,  so  that  2    <m<2    .   We  shall  prove  that  for 

every  2  ----  — — -- 

0(2^^)  +  c(m)  <  c(2'^+j)  +  c(in-j)  ■^-  (A.  2) 

We  know  that  this  inequality  is  valia  for:  all  k',  k'<k.   We  also 
have  that  if  i<j  then 

f(i)  <  f(j)  (A. 3) 

and,  since  f  is  concave,  if  i<j  and  0<r<(j-i)/2  then 

f(i)  +  f(j)  <  f(i+r)  +  f(j-r)  (A.4) 

We  proceed  with  a  proof  by  cases. 

1.   m<2  .   For  symmetry  reasons  we  may  restrict  ourselves  to  values 

k 
of  j  such  that  (m-2  )/2<j<m 

1.1.  j>2'^~-'-.   Then 
c(2^+j)  +  c(m-j) 

=  c(2^)+c(3)+f(2''+j)+c(m-j)  ^^^  ^'^^ 

>  c(2^)+c(j)+c(m-j)+f  (m)  (By  A. 3) 

>  c(2'^)+c(m)  . 

1.2.  0<j<2^"-'-.  Then 
c(2^+j)+c(m-j) 

=  c(2^"-'-)+c(2'^~^+j)+f  (2^+j)+c(m-j)  (By  A.l) 

>  c(2'^"^  +  j)+c(m-j)+f  (2'^)+c(2'^"^)  (By  A.  3) 

>  c(2'^"^)+c(m)+f  (2'^)+c(2'^"^)  (By  A. 2) 
=  c(2^)+c(m)  . 

1.3.  j<0 
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1.3.1.  m-j>3-2    .   Then 
c(2'^+j)+c(m-j) 

=  c(2^"^)-fc(2''"^+j)+f{2^+j)+c(2''"^)4c(m-j-2''~^)+f(iT^j)      (By  A.l) 

>  c(2'^"^)-fc(2''~^)+f(2^)4c(2''"^+j)4c(iT^j-2''"^)+f(in)  (By  A.  4) 

>  c(2^)+c(m)  . 

1.3.2.  m-j<3-2'^"^.  Then 
c(2^+j)+c(m-j) 

=  c(2''"^)4c(2^"^+j)+f(2^+j)4c(2''"2)+c(nTfj-2^"^)+f(n^j)       (By  A.l) 
>c(2''~^)+c(2^"^)+f(2^+j)-fc(2^~^)-ta(m-2^-2)+f(m_j)  (gy  a. 2) 

>c(2''"^)+c(2''"^)+f  (2^)+c(2^"2)+c(m-2''"2)+f  (m)       (By  A.  4) 
>c(2'^)+c(m)  . 

2«       iTi>2  .   We  have  to  consider  values  of  j  such  that 
-2'^<j<(m-2'^)/2. 

2.1.      j>0.   Note  that  ■3<2^~-^ 

2.1.1.  m-j<3-2'^"^.   Then 
c(2^+j)+c(m-j) 

=c(2^"l)+c(2^"^+j)+f(2^+j)+c(2^"^)+c(m-j-2^"^)+f (m-j)    (By  A.l) 

^c(2''"^)+c(2''"^)+f  (2''+j)+c(2''"l)+c(in-2^~^)+f(m-j)         (By  A.  2) 

>c(2^"^)+c(2^"^)+f (2^)+c(2^~^)+c(m-2^"^)+f (m)  (By  A. 4) 

^c(2'^)+c(m)  . 

2.1.2.  m-j>3.2^"^.   Then  m-2'^"^>3  •  2^^"^  and 
c(2'^+j)+c(m-j) 

=c(2^"^)+c(2''"^+j)+f  (2''+j)+c(2'')+c(m-j-2'^)+f  (m-j)         (By  A.l) 
>c(2^-^)+c(2''"^)+f  (2''+j)+c(2'')+c(m   -2^)+f(m-j)  (By  A. 2) 

>c(2''"^)+c(2^"^)+f  (2'')+c(2^)+c(in-2'')+f  (m)  (By  A.  4) 

^c(2'^)+c(m)  . 


2.2       j<0, 
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2.2.1.  m-j>3-2^"-'-.   Then 
c(2^+j)+c(m-j) 

=c(2^+j)+c(2'^)+c(m-j-2^)+f  (m-j)  (By  A.l) 

>c(2^)+c(2^+j)+c(m-j-2'^)+f  (m)  (By  A.  3) 

>c(2^)+c(m) 

2.2.2.  m-jO-2'^"-'-.   Note  that  m+2'^~"'"<3  •  2^,  so  that 
c(2'^+j)+c(m-j) 

=c(2^+j)+c(2'^"-'-)+c(m-j-2^",-'-)+f  (m-j)  (By  A.l) 

^c(2'^"-'-)+c(2'^+j)+c(m-j-2^"-'-)+f,(in)_  (By  A.  3) 

>c(2'^"^)+c(2'^)+c(m-2^"-'-)+f  (m)  (By  A.  2) 

>c(2'^)+c(m)  . 


D 


Note  again  that  if  f  is  strictly  concave  (A  f<0)  then 
the  decomposition  corresponding  to  a  solution  of  1.1  is  unique, 
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